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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed April 10, 2009 have been fully considered but they are not 
persuasive. 

2. With respect to Claims 9, 25, and 26, Applicant argues, "In applicant's invention, the 
server 24 has collected a plurality of images and the associated hyperlink of the computer 
location of where server 24 found the image and associated text and when a matching image is 
found the image and the URL of the original location of the image is provided to the user . . . 
Nowhere in Noda does it suggest a database of images and associated URLs of computers with 
web pages having in their content the image of interest." 

3. In response, the Examiner respectfully notes Applicant is arguing in favor of features 
which are not claimed as specifically as the arguments suggest. Applicant is reminded, although 
the claims are interpreted in light of the specification, limitations from the specification are not 
read into the claims. See In re Van Geuns, 988 F.2d 1 181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

4. The language of Claim 9, for example, recites a system comprised of a disjunctive series 
of independently functioning components. The claim language remotely relates the functionality 
of each of the components to one another. Thus, simply alleging "Noda does it suggest a 
database of images and associated URLs of computers with web pages having in their content 
the image of interest" is insufficient to overcome the Examiner's rejection. 

5. Nevertheless, Noda indeed describes where at least one of the computer files having an 
associated hyperlink and including an image similar to the captured image. Noda returns an 
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email to the PDA with a hyperlink to the similar images (see page 26, paragraph 3, lines 8-13; 
also see Figure 5). 

6. For these reasons, the Examiner will maintain the prior art rejection. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claims 9-22 and 24 - 28 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Noda et al. in view of Aarnio (US 6,522,889). 

NOTES: The Examiner notes Claims 9, 25, and 26 appear to be related as apparatus, 
storage medium, and method respectively. Accordingly, these claims will grouped together 
under one rejection using the language of Claim 9. Furthermore, the Examiner's above-response 
is fully incorporated in the rejections below. Finally, the Examiner notes that the storage 
medium claimed in Claim 25 is not described in the specification. Claim 25 has been directed 
towards a storage medium since its original filling. To be clear as to whether the "storage 
medium" is directed towards statutory subject matter, a paragraph should be added to 
specification including the types of statutory storage mediums that can be included. The 
paragraph should be consistent with the remainder of the specification and should not include 
any new matter. 

9. For Claims 9, 25, and 26, Noda et al. explicitly teach: 
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A system to provide location awareness services comprising: 

(a) a handheld device (digital camera, PDA, PHS, Figure 1) comprising: 

(i) a camera to capture an image of an location (digital camera, Figure 1); 

(ii) a mobile communication device (PHS, Figure 1), coupled to the camera and to 
a wireless network (WWW sever, Figure 1), to communicate the image to a server 
with existing image files to find similar images (page 25, abstract, lines 8-12) by 
locating and comparing the captured image with other existing image files; and 

(iii) a user interface (PDA, Figure 1 ), coupled to the mobile communication 
device, to communicate to an user any resulting relevant images and associated 
hyperlinks of found similar images (page 28, 3.5 and Figure 5); and 

(b) a computer network including the wireless network (WWW server, Figure 1) and a 
wired network (flower database, Figure 2); 

(c) a server (see Figure 1), connected to the computer network, to store images of 
interest; and 

(c) a plurality of computers (WWW server and flower database, Figure 1), each computer 
have a plurality of computer files and connected to the computer network (process information 
files and flower information files respectively), at least one of the computer files having an 
associated hyperlink and including an image similar to the captured image and when viewed 
includes associated text describing an object in the image (page 26, paragraph 3, lines 8-13, see 
also Figure 5). 

The Examiner respectfully notes, as described by item 3 (Image Retrieval System of 
Flowers), Noda uses characteristics entered by a user to generate a binary image of the captured 
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image (see 3.1), then calculates the characteristics of shape using a circularity measure (as 
defined by equation 1; see 3.2), then calculates the characteristics of color using a center of 
gravity calculation (see 3.3). Noda combines these characteristics into a table (see Table 1) and 
compares them to characteristics of other images in the database to find a match(s) (see 3.4). 
Once a match(s) is found, the image(s) is displayed on a webpage and the matched image(s) and 
URL of the webpage is sent to the user (see 3.5 and 2). 

However, Noda et al. do not explicitly teach to search for additional images of interest 
located on other computers connected to the network when an image of interest is not located on 
the server. 

In the same field of endeavor, Aarnio teaches a method and apparatus for providing 
precise location information through a communications network (Figures 1 and 3). Aarnio 
further teaches that the database to be accessed is a computer network 1 8, which may be the 
Internet, or World Wide Web (column 2, lines 57-60), which includes several databases that can 
then be checked. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the computer network found in Aarnio as the database in Noda et 
al. in order to pinpoint an exact location of the image by using the vast sources of the internet 
(column 1, lines 35-39). 

10. As for Claim 10, Noda et al explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein the user 
interface comprises a display (PDA, browser Figure 1, see also Figure 5). 

11. As for Claim 11, Noda et al explicitly teach: 
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The system to provide location awareness services as recited in Claim 9 wherein the user 
interface comprises a computer connection (PDA connects to computers wirelessly through PHS, 
Figure 1). 

12. As for Claim 12, Noda et al. explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein the 
associated text describes features of the object in the image including geographical location of 
the object (page 28, 3.5). 

13. As for Claim 13, Noda et al. explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein the 
associated text describes features of the object in the image including a description and historical 
facts regarding the object (page 28, 3.5). 

14. As for Claim 14, Noda et al. explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein the 
associated text includes a uniform resource locator (URL) (Figure 5, the word detail is 
considered the URL because when it is clicked the web address corresponding to the link is 
opened and seen in Figure 6). 

15. As for Claim 15, Noda et al explicitly teach: 

The system to provide location awareness services as recited in Claim 9, wherein at least 
one of the computers includes a plurality of computer files having images of fields of interest 
(flower database Figure 1). 
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However, Noda et al. do not explicitly teach that the database has information of 
locations of interest located within a predetermined radius about a geographical location. 

In the came field of endeavor, Aarnio teaches a method and apparatus for providing 
precise location information through a communications network (Figures 1 and 3). Aarnio 
further teaches a server service 24 that provides information to the user about the surroundings in 
the geographical region (column 4, lines 33-38). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the information about the geographical surroundings found in 
Aarnio into the images found in the database of Noda et al. in order to provide a convenience for 
the user such as in a case described in column 4, lines 38-43. 

16. As for Claim 16, the combination of Noda et al. in view of Aarnio, as applied to claim 
15, further teaches the system to provide location awareness services as recited in Claim 15 
wherein the computer having a plurality of computer files having images of objects of interest 
located within a predetermined radius about a geographical location (column 4, lines 33-38, 
Aarnio) was previously trained to find common objects known to be of interest (page 26-28, 3- 
3.5 explains the finding of common images). 

17. As for Claim 17, Noda et al. explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein at least 
one of the computers includes at least one computer file having an image of an object of known 
interest and an associated image of an object of less recognized interest within a predetermined 
radius about a geographical location of the known interest object (section 3.1 describes the 
extraction of the flower, which is the isolation of the image and at the same time the isolation of 
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the surroundings, therefore it is inherent that the surroundings can be used to identify an object 
of less interest using the same methods describe in the experimentation with real images 4.1) to 
aid a user in finding the object of less recognized interest. 

18. As for Claim 18, Noda et al. explicitly teach: 

The system to provide location awareness services as recited in Claim 9 wherein at least 
one of the computers includes at least one computer file having an image of an object of known 
interest and an associated image of an object of less recognized interest within the field of view 
of the known interest object (section 3.1 describes the extraction of the flower, which is the 
isolation of the image and at the same time the isolation of the surroundings, therefore it is 
inherent that the surroundings can be used to identify an object of less interest using the same 
methods describe in the experimentation with real images 4.1) to aid a user in finding the object 
of less recognized interest. 

19. As for Claim 19, Noda et al explicitly teach the system to provide location awareness 
services as recited in Claim 9, which includes at least one computer (flower database Figure 1). 

However, Noda et al. do not teach that the computer has the capability of searching other 
computers to find matching files. 

In the same field of endeavor, Aarnio teaches a method and apparatus for providing 
precise location information through a communications network (Figures 1 and 3). Aarnio 
further teaches that the database to be accessed is a computer network 18, which may be the 
Internet, or World Wide Web (column 2, lines 57-60), which includes several computers that can 
then be checked. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the computer network found in Aarnio as the database in Noda et 
al. in order to pinpoint an exact location of the image by using the vast sources of the internet 
(column 1, lines 35-39). 

20. As for Claim 20, the combination of Noda et al. in view of Aarnio, as applied to claim 
19, further teaches that the text that is found describing a matching image is communicated to the 
handheld device (page 25, 2.1, end of second paragraph). 

21 . As for Claim 21, the combination of Noda et al. in view of Aarnio, as applied to claim 
19, further teaches that the text is returned to the computer that began the search (Figure 4, in 
Aarnio, shows that the information that is found is returned to the mobile system, which is the 
computer that began the search). 

22. As for Claim 22, the combination of Noda et al. in view of Aarnio, as applied to claim 21 
above further teaches the system to provide location awareness services as recited in Claim 21 
wherein the computer that initiated the search is capable of comparing the original image with 
images returned in the computer file having text matching the associated text describing the 
object in the image (see figures 5 and 6, the PDA provides the user with the comparison of 
images that resulted from the original computer, database, to the image). 

23. As for Claim 24, the combination of Noda et al. in view of Aarnio, as applied to claim 
19, further teaches the system to provide location awareness services as recited in Claim 19 
wherein at least one of the computers includes at least one computer file having an image of an 
object of known interest and an associated image of an object of less recognized interest within 
the field of view of the known interest object (section 3.1 describes the extraction of the flower, 
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which is the isolation of the image and at the same time the isolation of the surroundings, 
therefore it is inherent that the surroundings can be used to identify an object of less interest 
using the same methods describe in the experimentation with real images 4.1) to aid a user in 
finding the object of less recognized interest all located within a predetermined radius about a 
geographical location. 

24. As for Claim 27, Noda et al. explicitly teach: The method for identifying a location as 
recited in Claim 26 wherein the comparing step includes comparing at least one of energy 
spectrum data, color histogram data, primitive filter data, and local invariant data (pages 26-38, 
3-3.4 mentions color characteristic extraction). 

25. As for Claim 28, Noda et al. explicitly teach: The method for identifying a location as 
recited in claim 26 wherein the comparing step comprises at least one of the techniques including 
a least square matching technique, a normalizing the image technique, an eigen value technique, 
a matching histogram of image feature technique and an image matching engine with 
transformation technique (pages 27-28, 3.4). 

26. Claim 23 is rejected under 35 U.S.C. 103(a) as being unpatentable over Noda et al. in 
view of Aarnio (US 6,522,889) and further in view of Reed (US/2005/01 131 13). 

27. As for Claim 23, the combination of Noda et al. in view of Aarnio teaches the system to 
provide location awareness services as recited in claim 15. 

However, the combination does not explicitly teach that the system includes a GPS 
system receiver to identify the geographical location of the mobile communication device and 
help eliminate non-useful images. 
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In the same field of endeavor, Reed teaches an enhance wireless phone (Figure 2). Reed 
further teaches that this wireless phone has a GPS system 26, which is described in paragraph 
[0114]. The GPS system locates the user and inherently would provide coordinates that could 
narrow down the image matching process. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the GPS capabilities of the mobile phone found in Reed into the 
system found in the combination of Noda et al. in view of Aarnio in order to pinpoint exact 
locations and provide the user with the ease of mind of always knowing their location. 

Conclusion 

28. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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29. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571 .272.73 13. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, David Ometz can be reached on 571 .272.7593. The fax phone number for the 
organization where this application or proceeding is assigned is 571.273.8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Justin P. Misleh/ 
Primary Examiner 
Group Art Unit 2622 
June 16, 2009 



